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Abstract 

In his investigation on large i^-automorphism groups of an alge- 
braic curve, Stichtenoth obtained an upper bound on the order of the 
first ramification group of an algebraic curve X defined over an al- 
gebraically closed field of characteristic p. Stichtenoth's bound has 
raised the problem of classifying all IC-automorphism groups G of X 
with the following property: There is a point P £ X for which 

\o?\ > (1) 

Such a classification is obtained here by proving Theorem 11.31 



1 Introduction 

Let K be an algebraically closed field of characteristic p > 0. Let Ant{X) be 
the K-automorphism group of a (projective, non-singular, geometrically irre- 
ducible, algebraic) curve X embedded in an r-dimensional projective space 
PG(r, K). If A" has genus g > 2, then Aut{X) is finite, but this does not hold 
for either rational or elliptic function fields. Over C, more generally in zero 
characteristic, the classical Hurwitz bound for curves of genus g > 2 is 

lAutWI <84((7-l). (2) 
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In positive characteristic, X with g > 2 may happen to have larger automor- 
phism group. Nevertheless, from previous work by Roquette [TS], Stichtenoth 
[T9[[20], Henn [lOj, Hansen and Petersen [9J, Garcia, Stichtenoth and Xing 

Qakgak and Ozbudak,^, Giulietti, Korchmaros and Torres Lehr and 
Matignon [16j, curves with very large automorphism groups comparing with 
their genera are somewhat rare. 

The Hermitian curve is the unique curve with |Aut(A')| > IQg^, see [TU] . 
If p > g then ([2]) holds with only one exception, namely the hyperelliptic 
curve v{YP - Y - X^) with g = ^{p + 1) and |G| = 2p{p^ - 1), see [18]. 
Curves with |Aut(A')| > 8g^ were classified in [10]: 

Theorem 1.1 (Henn). Let X be a projective, geometrically irreducible non- 
singular curve of genus g > 2. If a subgroup G of |Aut(A')| has order at least 
8g^, then X is birationally equivalent to one of the following plane curves: 

(I) The hyperelliptic curve v(y^ + Y + X"^^^^) with p = 2 and g = 2^~^; 
|Aut(A')| = 22'=+i(2'= + 1) and Ant{X) fixes a point P e X. 

(II) The hyperelliptic curve v(y^ — (X'' with p > 2 and g = ^{n — 1); 

either G/M ^ PSL(2, n) or G/M ^ PGL(2, n), where n is a power of 
p and M is a central subgroup of G of order 2. 

(III) The Hermitian cnri'e v(F"' + F — X"+^) withp > 2, and g = |(?7.^ — n); 
either G = PSU(3, n) or G = PGU(3, n) with n a power of p. 

(IV) The DLS curve (the Delign-Lusztig curve arising from the Suzuki group) 
v(X"«(X" + X) - (F" + Y)) with p = 2,no = 2'\ r > 1, n = 2nl, and 
g = no{n — 1); G = Sz{n) where Sz(n) is the Suzuki group. 

Another relevant example in this direction is the following. 

(V) The DLR curve ( the Delign-Lusztig curve arising from the Ree group ) 
v(X"o(X" + X) - (r" + r)) withp = 3, no = 3^ n>0,n = Sn^, and 
g = no{n — 1); G = Ree(n) where Ree(n) is the Ree group. 

An important ingredient in the proof of Theorem 11.11 as well as in other 
investigations on curves with a large automorphism group G, is Stichtenoth's 
upper bound on the order of the Sylow p-subgroup in the stabiliser Gp of a 
point P E X. In terms of ramification groups, such a Sylow p-subgroup is 
the first ramification group and the bound depends on the ramification 
pattern of the Galois covering X y where 3^ is a non-singular model of 
the quotient curve X/Gp\ 
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Theorem 1.2 (Stichtenoth). Let X he a projective, geometrically irreducible, 
non-singular curve of genus g >2. If P & X , then 

(i)| ^ 4P .2 



p — 1' 



More precisely, if Xi is the quotient curve X/G^p, then one of the following 
cases occurs: 

(i) Xi is not rational, and \Gp^\ < g; 

(ii) Xi is rational, the covering X ^ X\ ramifies not only at P but at some 
other point of X , and 

|g2'I < (3) 

(iii) Xi and X2 are rational, the covering X ^ X\ ramifies only at P , and 

.(2) 

^p_ 



Stichtenoth's bound raises the problem of classifying all automorphism 
groups G with the following property: There is a point P ^ X such that 

|G?l>^3. (5) 

In this paper, we obtain such a classification by proving the following result. 

Theorem 1.3. // ([T]) holds, then either G fixes P or one of the four cases 
(II),. . .,(V) in Theorem occurs. 



2 Background and some preliminary results 

Let A" be a projective, non-singular, geometrically irreducible, algebraic curve 
of genus g > 2 embedded in the r-dimensional projective space PG(r, K) 
over an algebraically closed field IK of positive characteristic p > 0. Let S be 
the function field of X which is an algebraic function field of transcendency 
degree one over K. The automorphism group Aut(A') of X is defined to be 
the automorphism group of S fixing every element of K. It has a faithful 
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permutation representation on the set of all points X (equivalently on the 
set of all places of S). The orbit 

o(P) = {Q\Q = P'^,aEG} 

is long if |o(P)| = IGI, otherwise o{P) is short and Gp is non-trivial. 

If G is a finite subgroup of Aut(A:'), the subfield S*-^ consisting of all 
elements of S fixed by every element in G, also has transcendency degree 
one. Let 3^ be a non-singular model of E*^, that is, a projective, non-singular, 
geometrically irreducible, algebraic curve with function field S"-^. Sometimes, 
y is called the quotient curve of A" by G and denoted hj X/G. The covering 
X y has degree |G| and the field extension T^/TP is of Galois type. 

If P is a point of X , the stabiliser Gp of P in G is the subgroup of G 
consisting of all elements fixing P. For i = 0, 1, . . ., the i-th ramification 
group Gp of A" at P is 

g5^^ = {a I ordp(a(t) - t) > i + 1, a G Gp}, 

where t is a uniformizing element (local parameter) at P. Here Gp"* = Gp 
and Gp^ is the unique Sylow p-subgroup of Gp. Therefore, Gp^ has a cyclic 
complement H in Gp, that is, Gp = Gp"* x H with a cyclic group H of order 
prime to p. Furthermore, for i > 1, Gp"* is a normal subgroup of G and the 
factor group is an elementary abelian p-group. For i big enough, 

G^p is trivial. 

For any point Q of X, let cq = \Gq\ and 

Then rfg > eg — 1 and equality holds if and only if gcd{p, \Gq\) = 1. 

Let g' be the genus of the quotient curve X/G. The Hurwitz genus for- 
mula together with the Hilbert different formula give the following equation 

2g-2=\G\{2g'-2)+J2dQ. (6) 

If G is tame, that is p f |G|, or more generally for G with p\ eg for every 
Q E X, Equation ([6]) is simpler and may be written as 

k 

2g-2 = \G\{2g'-2) + Y,i\G\-m (7) 

i=l 
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where ii, . . . ,ik are the short orbits of G on A". 

Let Gp = G^p^ X H. The following upper bound on depending on g 
is due to Stichtenoth [T9] : 

\H\ < 4^ + 2. 

For any abelian subgroup G of Aut(A:'), Nakajima p?7J proved that 

I I r 4^ + 4 for p^2, 
' ' - \ 4c/ + 2 for p = 2. 

Let C be the projective line over K. Then Aut(£) = PGL(2,K), and 
Aut(£) acts on the set of all points of C as PGL(2, K) naturally on PG(2, K). 
In particular, the identity of Aut(£) is the only automorphism in Aut(£) 
fixing at least three points of C Every automorphism a G Aut{£) fixes a 
point; more precisely, a fixes either one or two points according as its order 
is p or relatively prime to p. Also, G^p^ is an infinite elementary abelian 
p-group. For a classification of subgroups of PGL(2,K), see [23] . 

Let S be an elliptic curve. Then Aut(£^) is infinite; however for any point 
P ^ S the stabiliser of P is rather small, namely 

( 2,4,6 whenp^ 2,3, 

\Aut{S)p\=< 2,4,6,12 whenp = 3, 

( 2,4,6,8,12,24 when p = 2. 

Let be a (hyperelhptic) curve of genus 2. For any solvable subgroup G 
of Aut(jF), Nakajima's bound together with some elementary facts on finite 
permutation groups, yield |G| < 48. 

In the rest of this Section, A" stands for a non-hyperelliptic curve of genus 
g > 3, and it is assumed to be the canonical curve of ^{X). So, X is a non- 
singular curve of degree 2g — 2 embedded in PG((y' — 1, K), and the canonical 
series of K{X) is cut out on X by hyperplanes. Let l,Xi, . . . denote 
the coordinate functions of this embedding with respect to a homogeneous 
coordinate frame (Xq, Xi, . . . , Xg^i) in PG{g — 1, K). 

For a point P E X, the order sequence of at P is the strictly increasing 
sequence 

MP) = < Jl(P) = 1< UP) <...< Jg-l{P) (8) 

such that each jj(P) is the intersection number J(P, Xr\Hi) of X and some hy- 
perplane Hi at P, see [21]. For i = g — 1, such a hyperplane i^g-i is uniquely 
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determined being the osculating hyperplane to X at P. Another charac- 
terisation of the integers ji{P), called P-orders or Hermitian P-invariants, 
appearing in ([8]) is that j is a P-order if and only if j + 1 is a Weierstrass gap, 
that is, no element in K(A') regular outside P has a pole of order j + 1. Now, 
assume that jg„i(P) = 2g — 2, that is, P is the unique common point of 
with X. Then the hyperplanes of PG{g — 1,K) whose intersection number 
with at P is at least jg-2{P) cut out on X a. linear series of degree 
n = 2g — 2 — jg_2(P) and projective dimension 1. Let i be the projective line 
over K. Then gj^ gives rise to a covering X ^ i of degree n which completely 
ramifies at P. If it also ramifies at the points Pi, . . . ,Pk of A" other than P, 
that is ep^ > 1 for i = 1, . . . , k, then (jS]) yields 

k k 

2g-2 = -2n + dp + ^dp^> -{n + l) + ^dp.. (9) 

1=1 1=1 

Note that n must be at least 3 as A* is neither rational, nor elliptic and nor 
hyper elliptic. 

From finite group theory, the following results and permutation represen- 
tations play a role in the proofs. 

Huppert's classification theorem, see [HI Chapter XII]: Let G be a solvable 
2-transitive permutation group of even degree n. Then n is a power of 2, and 
G is a subgroup of the affine semi-linear group ArL(l,n). 

The Kantor-O'Nan-Seitz theorem, see [I5]: Let G be a finite 2-transitive 
permutation group whose 2-point stabiliser is cyclic. Then G has either a 
regular normal subgroup, or G is one of the following groups in their natural 
2-transitive permutation representations: 

PSL(2,n), PGL(2,n), PSU(3,n), PGU(3, n), Sz(n), Ree(n). 

The natural 2-transitive permutation representations of the above linear 
groups: 

(i) G = PGL(2,n), is the automorphism group of PG(1,?t,); equivalently, 
G acts on the set Q of all F„-rational points of the projective line 
defined over F„. The natural 2-transitive representation of PSL(2,?7-) 
is obtained when PSL(2,n) is viewed as a subgroup of PGL(2,?i), 

(ii) G = PGU(3,n) is the linear coUineation group preserving the clas- 
sical unital in the projective plane PG(2,r;,^), see [12]; equivalently 



6 



G is the automorphism group of the Hermitian curve regarded as a 
plane non-singular curve defined over the finite field F„ acting on the 
set VL of all F„2-rational points. PSU(3,?7.) can be viewed as a sub- 
group of PGU(3,n) and this is the natural 2-transitive representation 
of PSU(3,n). 

(iii) G = Sz{n) with n = 2nQ, uq = T' and r > 1, is the linear collineation 
group of PG(3,n) preserving the Tits ovoid, see [221 ISSl H^; equiva- 
lently G is the automorphism group of the DLS curve regarded as a 
non-singular curve defined over the finite field F„ acting on the set 
of all F„-rational points. 

(iv) G = Ree(n) with n = Sn^, hq = 3^ and r > 0, is the linear collineation 
group of PG{7,n) preserving the Ree ovoid, see p2]; equivalently, G is 
the automorphism group of the DLS curve regarded as a non-singular 
curve defined over the finite field F„ acting on the set Q of all F„-rational 
points. 

For each of the above linear groups, the structure of the 1-point stabilizer 
and its action in the natural 2-transitive permutation representation, as well 
as its automorphism group, are explicitly given in the papers quoted. 

Cyclic fix-point-free subgroups of some 2-transitive groups. The following 
technical lemma is a corollary of the classification of subgroups of PSU(3, n) 
and Ree(r;,). 

Lemma 2.1. Let G be a 2-transitive permutation group of degree n. Let U be 
a cyclic subgroup of G which contains no non-trivial element fixing a point. 

(i) IfG = PSU(3,?2) in its natural 2-transitive permutation representation, 
then \U\ divides either n+1 or n"^ — n -\- 1. 

(a) If G = Sz{n) in its natural 2-transitive permutation representation, 
then \U\ divides either n + 1, or n — 2nQ + 1, orn + 2no + 1. 

(iii) If G = Ree(n) in its natural 2-transitive permutation representation, 
then \U\ divides either n + 1, or n — Suq + 1, or n + 3no + 1. 

Schur multiplier of some simple groups. For a finite group G, a group F 
is said to be a covering of G if F has a central subgroup U, i.e. U C Z(T), 
such that G = V/U. If, in addition, F is perfect, that is F coincides with 
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its commutator subgroup, then the covering is called proper. For a simple 
group G, a perfect covering is also called a semisimple group. From Schur's 
work, see |T] and |T3l V.23,24,25], if G is a simple group, then it possesses 
a "universal" proper covering group T with the property that every proper 
covering group of G is a homomorphic image of f. The center Z{r) is called 
the Schur multiplier of G. The Schur multipliers of simple groups are known, 
see Griess [ZIIBIE]. In particular, the Schur multiplier of PSL(2, q) with g > 5 
odd, has order 2; PSU(3, q) with g > 3 has non-trivial Schur multiplier only 
for 3|(g + 1), and if this occurs the Schur multiplier has order 3; Ree(n) with 
n > 3 has trivial Schur multiplier. Therefore, the following result holds. 

Lemma 2.2. Let G be a simple group isomorphic to either PSU(3,?2) with 
n > 3, or Ree(n) with n > 3. If the center Z{r) of a group F has order 2 
and G = T/Z{T) then F has a subgroup isomorphic to G and F = Z{G) x G. 



3 Large ^-subgroups of Aut(A') fixing a point 

In this section. Theorem 11.31 is proven. 

We assume that case (iii) of Theorem 11.21 with G ^ Gp occurs. In terms 
of the action of Gp on X, Theorem 11.21 (iii) implies that 

(*) no non-trivial p- element in Gp fixes a point distinct from P. 

Let Q be the set of all points R (z X with non-trivial first ramification group 
G^"*. So, Vt consists of all points R E X which are fixed by some element of 
G of order p. Since P e Q and G 7^ Gp, Vt contains at least two points. It 
may be noted that the 2-point stabilizer of G is tame and hence cyclic. 

Choose a non-trivial element z from the centre of a Sylow p-subgroup 
Sp of G containing Gp'*. Then z commutes with a non-trivial element of 
Gp\ This together with (*) imply that z fixes P. Therefore, z G Gp\ In 
particular, z fixes no point of X distinct from P. Let g E Sp. Then zg = gz 
implies that 

(^pay = p9^ — pzg _ (^p^y = p9 

whence P^ = P. This shows that every element of Sp must fix P, and 
hence Sp = Gp\ Since the Sylow p-subgroups of G are conjugate under G, 
every p-element fixes exactly one point of X. From Gleason's Lemma, see [3l 
Theorem 4.14], f2 is a G-orbit, and hence the unique non-tame G-orbit. 
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By (iii) of Theorem 11.21 the quotient curve Xi = X/Gp is rational. This 
imphes that y = X/G is also rational. 

If there are at least two more short G-orbits, say Qi and Q2, from ([7]), 

2g-2 > -2\G\ + {\Gp\ + \gP\ + \gP\-3)\Q\ 
+{\Gq,\-1)\Qi\ + {\Gq,\-1)\Q2\, 

where Qi ^ Qi for i = 1, 2. Note that 

(\Gq,\ - + {\Gq,\ - m^l > \G\ 

since \Gq^\ — 1 > ||GqJ, and \G\ = \Gq^\ Also, \G\ = \Gp\ and 
IGp"*! > 1 by (iii) of Theorem II. 2[ Therefore, 

2^-2 > {\gP\-1)\Q\. 

Since > 2, this implies that g > |Gp''|, a contradiction. 
Therefore, one of the following cases occurs: 

(i) Q is the unique short orbit of G; 

(ii) G has two short orbits, namely Q and a tame G-orbit. Furthermore, 
either 

(iia) there is a point R & Q such that the stabiliser of i? in Gp is trivial; 

(iib) no point R ^ Q with the property as in (iia) exists. 

Before investigating the above three cases separately, a useful equation is 
established. 

Since Xi is rational, from (*) 

2^ - 2 + 2\g'p>\ = 2\gP\ -2 + \G^p>\ -l + ... = dp- \Gp\ + {G'^PI. (10) 
Therefore, 

dp = 2g-2+\G'p^\ + \Gp\. (11) 
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3.1 Case (i) 



We prove that only one example occurs, namely the DLR curve for n = 3. 

From (*) it follows that > \G^p'^\ + l whence \n\ > g - Ihy (Q. On 
the other hand, gives 

2g-2 = -2\G\ + degD (X/G) = \n\ {dp - 2\Gp\). (12) 

whence \Q\ is a divisor of 2g ~2. Therefore, \Q\ = 2g — 2 and dp = 2\Gp\ + 1. 
This and (fTT!) give 

2g-2 + \G^p^\-\Gp\ = l. (13) 

Since Gp = G^^ x H, it follows that 2g - 2 = {\H\ - l)\G'p^\ + 1. This and 
imply that \H\ = 2. 

Therefore, p ^ 2 and \G^P\ = 2g — 3. Since = 2g — 2 and Gp only fixes 
P, this implies that Gp^ acts on \ {P} as a transitive permutation group. 
Hence, = g + 1 with g = IGp"*!- Since is a G-orbit, it follows that G 
induces on Q a. 2-transitive permutation group G whose one-point stabiliser 
has order either q or 2q according as |G| = 2|G| or G = G. 

lf\G\ = 2\G\, the subgroup H is the kernel of the permutation representa- 
tion of G on Q; that is, H fixes every point in Q. In particular, if is a normal 
subgroup of G. Therefore, G can be viewed as a K-automorphism group of 
the quotient curve Z = X/G. Let P' be the point of Z lying under P. Since 
2\\GP\it follows that G^p^ = G^p] . Also, the points of Z lying under the 
points in form the unique short G-orbit. Therefore, case (i) occurs for Z 
and G. From what was shown before, this implies that Gpi = Gp} x H with 
\H\ = 2 But this is impossible as the stabiliser Gpr has order q. 

If G = G, two cases are distinguished according as G is solvable or not. In 
the former case, Huppert's classification theorem implies that q + 1 = d'' with 
d prime. Since \Q\ = 2(7 — 2 is even, so d = 2. From Huppert's classification 
for d = 2 it also follows that Gp is a subgroup of the 1-point stabiliser of 
ArL(l, q + 1), and hence |Gp| divides kq. On the other hand, g + 1 = 2^ can 
only occur when k and q are both primes. Since |Gp| = 2q, this implies that 
k = 2. Hence q = g = 3; that is, p = 3 and IGp"*! = g = 3 which contradicts 

HID- 

Suppose that G is not solvable. If G has a regular normal subgroup M, 
then G/M is not solvable. On the other hand, |Gp| = 2q and \M\ = 
From |G| = |Gp||Jl|, it follows that \G/M\ = 2q. But this is not possible for 
a non-solvable group, as g is a prime power. 
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If G does not have a regular normal subgroup, then we apply Kantor- 
O'Nan-Seitz theorem. Since IGI = 2g, this shows that either \VL\ = 6 and 
G = PSL(2,5), or = 28 and G = Ree(3). In the former case, \G^p'^\ = 5 
and g = 4:] hence ([I]) does not hold. In the latter case, IG^^I = 27and^ = 15. 
This is consistent with ([1]), and X is the smallest DLR curve. Therefore (V) 
holds for q = V? with n = 3. 



3.2 Case (iia) 

We prove that no example occurs. Let A denote the unique tame orbit of G. 
Choose a point P from Vt and a point Q from A. Let 

N =\GQ\{dp-\Gp\)~\Gp\. 

Then 

|G| = 2(,-1)M^^|1^, (14) 

where Gp = G^p'^ x H. 

By hypothesis, there exists a point R E fl such that the the orbit o{R) 
of R under Gp is long. Let o'{R) denote the orbit of R under G. Then 
|o'(i?)| ■ \Gr\ = \G\. Since P and R lie in the same orbit fl of G, so Gr = Gp. 
Also, o{R) is contained in o'{R). Therefore, 

\Gp\ < ^ = 2(^; - 1) ■ ^ < 2(^ - 1)|Gq|. (15) 

Now, a lower bound on is given. As 

A^ > dp\GQ\ - \Gp\\Gq\ - 2{g - 1)|Gq|, 

so 

N>\GQ\{dp-\Gp\-2{g-l)). (16) 
This and ^ imply that N >\G^p\\Gq\. From (fT5|), 

N<2{g-l)\GQ\/\Gp\. 
Hence \Gp\\Gf\ < 2{g-l). Since \Gp\ > 1, this contradicts ([1]). 
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3.3 Case (iib) 



We prove that X is one of the examples (II), (III), (IV) and (V) with q > 3 
in (V). Let A denote the unique tame orbit of G. Choose a point P from Q 
and a point Q from A. 

First the possible structure of G and its action on fl are investigated. 

Lemma 3.1. G acts onflasa 2-transitive permutation group. In particular, 
\Q\ = q + 1 with q = p^, and the possibilities for the permutation group G 
induced by G on fl are as follows: 

(1) G'^PSL(2,g) or PGL(2,g); 

(2) G'^PSU(3,n) orPGU(3,n), with q = n^; 

(3) G = Sz(n), with p = 2, n = 2nl, uq — 2*^, with k odd, and q — r?; 

(4) G = Ree(n) with p = 3, n = ?>n\, uq = 3^", and q = n^; 

(5) a minimal normal subgroup of G is solvable, and the size of fl is a 
prime power. 

Proof. For a point P & Q, let Qq = {P},Qi, . . .Q^. with k > 1 denote the 
orbits of Gp^ contained in f2. Then, fl = [J^=o^i- prove that G acts 
2-transitively on it suffices to show that k — 1. 

For any i with 1 < i < A;, take a point R e Qj. By hypothesis, R is fixed 
by an element a E Gp whose order m is a prime different from p. Since 
IGpl = IGp"*!!-/!/^! and m divides \Gp\, this implies that m must divide \H\. 
By the Sylow theorem, there is a subgroup H' conjugate to if in Gp which 
contains a; here, a preserves Jlj. 

Since the quotient curve Xi — X /G^p is rational, a fixes at most two 
orbits of G'^p . Therefore, VIq and Vli are the orbits preserved by a. As H' 
is abelian and a G H' , this yields that H' either preserves both f2o and Vli 
or interchanges them. The latter case cannot actually occur as H' preserves 
VIq. So, the orbits ^-nd are also the only orbits of Gp"* which are fixed 
by H'. Since Gp = Gp^ xi H', this imphes that the whole group Gp fixes 
Qj. As i can be any integer between 1 and k, it follows that Gp fixes each of 
the orbits Qq, fli, . . . , flk- Hence, either A; = 1 or Gp preserves at least three 
orbits of Gp\ The latter case cannot actually occur, as the quotient curve 
Xi = X/Gp^ is rational. 
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Therefore k = 1. Also, the size of is of the form q + 1 with q = |Gp'*|; 
in particular, g is a power of p. 

Let G denote the 2-transitive permutation group induced by G on Q. We 
apply the Kantor-O'Nan-Seitz theorem to G. Up to isomorphism, G is one 
of the groups on the list, with G acting in each of the first four cases in its 
natural 2-transitive permutation representation. □ 

We also need the following consequence of Lemma I3.1[ 

Lemma 3.2. The subgroups Gp and Gq have trivial intersection, and Gq 
is a cyclic group whose order divides q + 1. Also, 



\G\i\Gp 




\ ^ p \ 


\Gq\) 




\Gq\{ 


\G\ 






pI) 



2^;-2= '^ r^T'^ (17) 



Proof. Let a G Gp fl Gq be non-trivial. Then p \ orda, and hence a & H. 
This shows that a fixes not only P but another point in Q, say R. Since 
Q ^ Q, this shows that a has at least three fixed points. These points are 
in three different orbits of Gp\ Since the quotient curve Xi = X/Gp^ is 
rational, this implies that a fixes every orbit of G^p\ a contradiction. Hence 
\Gp n Gq\ = 1. Therefore, no non-trivial element of Gq fixes a point in Q. 
Since \Q\ = q + 1, the second assertion follows. Substituting dp from (fTT|) 



into ([H]) gives □ 

First the case when the action of G is faithful on Q is considered. 
If G ^ PGL(2,g), then 

\G\=q'-q, \Gp\ = q'-q, = g. 

From Theorem II. 2( iii). the second ramification group Gp is non-trivial. As 
G = PGL(2,g), Gp has a unique conjugacy class of elements of order p. 
Since G^p is a normal subgroup of Gp, if G G^p with i > 1 then every 
conjugate of g in G also belongs to Gp . Therefore, 

^(1) _ ^(2) _ _ ^{k) |^(fc+l)| _ -I 
Lrp — (jp — ... — Lrp , |>-Jp | — -L. 

Since the quotient curve Xi = X/Gp^ is rational, from 

2g = {q~l)ik-l). 
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By (PP), this is only possible for = 2. Therefore g = ^{q — 1) with g > 5 
odd, and \Gq\ = | + !)• 

Let q = 1 (mod 4). Then 2g — 2 = 2 (mod 4), and an involutory element 
in PGL(2, q) \ PSL(2, q) has a no fixed point on fl. Since Gq has odd order, 
such an involutory element in PGL(2,g) \ PSL(2,g) has no fixed point in 
A, either. Therefore, an involutory element in PGL(2,g) \ PSL(2,g) fixes 
no point of X. From ([7]) applied to such an involutory element 2g — 2 = 
(mod 4), a contradiction. 

Let q = 3 (mod 4), then 2g — 2 = (mod 4) and an involutory element 
in PGL(2, g) \PSL(2, q) has exactly two fixed points in Q. As before, 2 f \Gq\ 
implies that such an involutory element has no fixed point in A. Therefore, 
an involutory element in PGL(2,g) \ PSL(2,g) fixes exactly two points of 
X. From ([7]) applied to such an involutory element 2g — 2 = 2 (mod 4), a 
contradiction. Therefore, the case G = PGL(2, q) does not occur. 

If G ^ PSL(2, q) with q odd, then 

\G\ = liq'-q), |Gp| = i(g2-g), = g. 

The previous argument depending on the higher ramification groups at P 
still works as Gp has two conjugacy classes of elements of order p, and each 
of them generates Therefore, k = 2 and hence g = ^{q — 1). But to 

show that this case cannot actually occur, more is needed. 

The K-automorphism group of a hyperelliptic curve in odd characteristic 
contains a central involution, say a. Since a commutes with every p-element 
of G, from (*) it follows that a must fix Q pointwise. If P G fi, then \Gp\ is 
even. But then the automorphism group generated by Gp together with a 
is not cyclic although it fixes P; a contradiction. 

Therefore, X is not hyperelliptic. So, X may be assumed to be the 
canonical curve of K(A') embedded in PG{g — 1,K). Then G is isomorphic 
to a linear collineation group F of PG(5' — 1,K) preserving X such that the 
restriction of the action of F on is G. To simplify notation, the symbol G 
is used to indicate F, too. 

Lemma 3.3. Let G = PSL(2,g) with q odd. Then 

(1) jg^^{P) = 2g-2; 

(2) Let Hg^2 be a hyperplane ofPG{g — 1,K) such that 

I{P,XnHg^2)=Jg^2{P). 
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// Hg_2 contains a point i? G f2 distinct from P, then 



I{R,XnHg^2)=2g-2-jg_2iP) 

and hence P and R are the only common points of X and Hg_2- 

Proof. To show (1) assume on the contrary that the osculating hyperplane 
Hg^i to at P contains a point S E X distinct from P. Since G^^ preserves 
Hg^i, the G'p''-orbit of S hes in Hg^i. Since such a G'p''-orbit is long, this 
implies that Hg^i contains from X at least q points other than P. Hence, 
degA" > jg_i(P) + q. On the other hand, jg-i{P) > g — 1. Therefore, 

degX >g-l + q> g- l+pg/{p - 1) > 2^ - 2, 

contradicting degA" = 2g — 2. 

Similar argument may be used to show (2). Again, assume on the contrary 
that Hg_2 contains a point T G A" other than P and R. As Hg_i does 
not contain R, Hg_2 is the unique hyperplane through R whose intersection 
number with at P is jg-2{P)- In particular, the stabiliser H of R in Gp 
preserves Hg^2- Since the if -orbit of T is long, Hg-2 contains from X at 
least I (g — 1) points other than P and R. On other hand jg-2{P) ^ g ~ 2. 
Therefore, 

2g-2 = degX >g-2 + l + l{q~l), 
whence (7 > | (g + 1), a contradiction. □ 

Since f2 is a Gp^-orbit, Lemma [3.3( 2) shows that for every R E Q,\ {P} 
there exists a hyperplane Hg_2{R) such that 

I{P,XnHg_2{R))=Jg-2{P), I{R,XnHg^2{R))=n = 2g-2~jg_2{P). 

Since such hyperplanes are distinct for distinct points R, from (Q it follows 
that 2g — 2 > —{n + 1) + q{n — 1) with n > 3. As (7 = | (g — 1), this leaves 
just one possibility, namely g = 5, = 2, n = 3. But then X would be 
hyperelliptic, a contradiction. Therefore the case G = PSL(2,g) does not 
occur. 

If G ^ PSU(3, n) with q = then 

IGI = {n^ + l)n^n^ - \Gp\ = n\n^ - \gP\ = n\ 
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where /z = gcd(3, n + 1). By (IT7I) . 

Since ([T]) is assumed, Lemma 12.11 (i) together with the first two assertions in 
Lemma [221 ensure the existence of a divisor t > 1 of (n^ — n + l)//i such that 
\Gq\ = {n^ — n + l)/{tn). Hence 

2g = {n-l){t{n + lf - (n^ + n + l)). (18) 

Since t is odd, this and ([1]) imply that t = 1. Then g = ^n{n — l). Therefore, 
(III) holds. Since PSU(3, n) is a subgroup of PGU(3, n) of index /i, the above 
argument works for G = PGU(3,n). 

If G = Sz{n) with q = and n = 2nQ for a power tt-q > 2 of 2, then 

IGI = (^2 + l)n\n - 1), |Gp| = n\n - 1), jG^i^l = n\ 

By dZD, 

_ (n + 2^0 + l)(r2 - 2no + l)(r2 - 1) ^ , ^ ^ 

From the preceding argument depending on ([1]) and Lemmas 12.11 and 13. 2[ 
there is an odd integer t such that either (A) or (B) holds, where 

(A) 2g = {t-l)in^ -l)-2tno{n-l), \Gq\ = {n + 2no + 1) /t; 

(B) 2g = {t-l){n^ -l) + 2tno{n-l), \Gq\ = {n - 2no + l)/t. 

In case (A), t must be at least 3. But then ([1]) does not hold except for 
no = 2. In the latter case, however, t does not divide n + no + 1 = 11. In 
case (B), ([T]) implies that t = 1. Then g = nQ{n — 1) . Therefore, (IV) holds. 
If G = Ree(n) with q = and n = Sn^ for a power ng > of 3, then 

\G\ = {n^ + l)n%n-l), \Gp\=n%n-l), \G^p\=n^. 

By (HZD, 

/ f (n + 3no + l)(n-3no + l)(n+l) ,0 
2g={n- 1) (^^ ^ '^G^ - {n^ + n + l)j . 
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Again the previous argument based on ([T]) and Lemmas 12.11 and 13.21 works 
showing this time the existence of an integer t > 1 such that either (A) or 
(B), or (C) holds, where 

(A) 2g = {n-l)[{t-l){n' + l)-{t + l)n], \Gq\ = {n + l)/t; 

(B) 2g = {n- l)[t{n'^ - 1) - ^tnuo + n{2t - 1) - 3tno + t-l], 

\Gq\ = {n + 3no + l)/t; 

(C) 2g = n- l)[t{n^ - 1) + ^tnno + n{2t - 1) + 3tno + t-l], 

\Gq\ = {n-3no + l)/t. 

In case (A), hypothesis ([T]) yields that t = 2. Then \Gq\ = |(n + 1), 
hence \Gq\ is even. But this is impossible as every involution in Ree(n) has 
a fixed point. 

If case (B) occurs, then t > 2. Since t is odd and t ^ 3, t must be at least 
5. But then ([1]) does not hold. 

If case (C) holds with t = 1, this (C) reads 2g = 3nQ{n — l){n + Uq + 1), 
and (V) for n > 3 follows. Otherwise, t > 5 contradicting ([T]). 

It remains to investigate the possibility of the permutation representation 
G of G on Q having non-trivial kernel. Such a kernel M is a cyclic normal 
subgroup of G whose order is relatively prime to p. By Lemma 13.21 no point 
outside Q is fixed by a non-trivial element in M. Let g be the genus of the 
quotient curve y = X/M. From ([7]) applied to M, 

2(7-2=|M|(2^-2) + (|M|-l)(g + l). 

By (P, this implies that either |M| = 2, or |M| = 3 and ^ = 0. 

Suppose first that \M\ = 2, g = 0. Then, g = ^{q — 1) and 3^ is rational. 
So, y may be assumed to be the projective line i over K. Let fl' be the set 
of all points of i which lie under the points of fl. Then \Q'\ = \Q\ and G 
acts on Q' and Q in the same way. So, G may be viewed as a subgroup of 
PGL(1, K) acting on a subset Q' of i. This shows that no non-trivial element 
of G fixes three distinct points. 

Assume that G has a regular normal subgroup. Arguing as in Case (i), 
this yields g + 1 = 2'^ with both q and k primes. In particular, q = p with 
p — 1 > g = I (p — 1). From Roquette's theorem [18], |G| < 84:{g — 1) = 
42(p — 3). On the other hand 

\G\>2{p+l)p, 
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as G is doubly transitive on f2. This together with p + 1 = 2^ leaves only 
one possibility, namely p = 7, A; = 3, = 3, jGI = 112 and G is sharply 
2-transitive on Vt. In particular, \Gp\ = 14, \G^p\ = 7. But then f[T7l) yields 
that \Gq\ = 1, a contradiction. 

If G has no regular normal subgroup, from the classification of Zassenhaus 
groups either (5 is a sharply 3-transitive group on Q, or G is PSL(2,g), 
Therefore, \G\ = 2g(g — l)(g + l) in the former case, and \G\ = — l)(g+l) 
in the latter case. In both cases, \G\ > 8(1 {q - If) = 8g^. By Theorem [LH 
(II) holds. 

Suppose next that |M| = 2, ^ = 1. Since Gp^ may be viewed as a sub- 
group of Aut(3^) of the elliptic curve y = X/M, the order of G^p^ does not 
exceed 24. Thus, q is one of the integers 2, 3, 4, 8. This leaves just one case, 
namely q = p = g = S, but then ([1]) fails. 

Suppose now that \M\ = 2, g > 2. Then holds for y = X/M with 
G acting faithfully on Q. From what proven before, either G contains a 
subgroup G' = PGU(3, n) of index gcd(3, n + 1), or (5 = Ree(n) with n > 3. 

In the former case, let G' be the subgroup of G for which G'/M = G'. 
Since |M| = 2 and hence M C Z{G), Lemma O implies that G' = M x U 
with U = PSU(3,n). Also, U acts on fl as PSU(3, n) in its natural 2- 
transitive permutation representation. Since the one-point stabiliser Up of 
U with P & Q contains a cyclic subgroup V of even order, it turns out that 
the the subgroup of G generated V and M is a not cyclic, although it fixes 
P; a contradiction. 

In the latter case, the same argument works for G = G' = Ree(n). 

Finally, suppose that \M\ = 3, g = 0. Then g = q — I. This together 
with ([T]) imply that p>g + l = q, a. contradiction. 
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